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Abstract 

Procedures  for  orthogonalisation  of  Gaussians  and  B-splines  are  recalled  and  it  is  shown 
that,  provided  Gaussians  are  negligible  in  appropriate  regions,  the  same  recurrence  for- 
mulae may  be  adopted  in  both  and  render  the  computation  relatively  efficient.  Chebyshev 
polynomial  collocation  is  well  known  to  be  rapidly  defined  by  discrete  orthogonalisation, 
and  similar  ideas  are  commonly  applicable  to  partial  differentieal  equations  (PDEs)  and 
integral  equations  (IEs).  However,  it  is  shown  that  the  most  elementary  mixed  methods 
(both  boundary  conditions  and  PDEs  being  satisfied)  for  the  Dirichlet  problem  in  rect- 
angular types  of  domain  can  lead  to  a singular  linear  system,  which  may  be  rendered 
non-singular,  for  example,  by  a small  modification  of  interpolation  nodes. 


1 Introduction 

Gaussian  radial  basis  functions  (RBFs)  are  negligible  outside  a certain  range,  which  de- 
pends on  the  accuracy  required  and  the  exponent  used.  For  example,  if  four  decimal  place 
accuracy  is  sufficient,  then  outside  [—2, 2]  the  function  e~Xx  is  negligible  for  A > 2.5. 
Indeed  the  translated  RBFs 

<f>i{x)  = i — —1,0, . . . ,n  + 1,  (1.1) 

resemble,  at  least  superficially,  a set  of  translated  cubic  B-splines,  each  having  a support 
of  four  sub-intervals  of  length  one,  contained  in  [i  - 2,i  + 2]. 

Following  work  of  Mason  et  al  [4]  and  Goodman  et  al  [1],  we  show  that  these  RBFs, 
rounded  to  the  required  accuracy,  may  be  conveniently  and  efficiently  orthogonalised  so 
that 
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(i)  a 4 term  recurrence  may  be  adopted  identical  to  the  one  in  [4] 

for  cubic  B-splines,  - 

(ii)  inner  products  may  be  determined  very  simply  in  terms  of  4 parts 
of  a normal  distribution, 

(iii)  a well  conditioned  calculation  results  and  best  l2  approximations 
may  be  obtained  immediately  with  an  orthogonalised  basis, 

(iv)  a continuous  or  discrete  inner  product  (and  best  approximation) 
may  be  adopted. 

In  a second  application  of  orthogonalisation,  this  time  to  polynomials,  it  is  shown 
that  a two-dimensional  (n+ 1)  x (n  + 1)  polynomial  collocation  problem,  which  includes 
amongst  its  nodes  n Chebyshev  polynomial  zeros  on  each  of  4 sides  of  a square,  leads  to 
a singular  (rank  one  deficient)  system.  For  all  n,  one  superfluous  equation  is  readily  iden- 
tified and  a suitable  replacement  equation  is  readily  found.  Discrete  orthogonalisation  is 
used  to  combine  and  greatly  simplify  the  equations  and  prove  singularity. 

2 Orthogonalised  Gaussians 

An  orthogonal  system  {Pi}  is  developed  from  the  Gaussians  fc  in  (1.1)  using 


Pk  = <t>k  - o,kiPk-i  ~ a/c2-Pfc-2  - a/b3-Pfc-3!  k = -1, . . . , n + 1,  (2.1) 

where  013  = ao3  = 002  = fl-1,3  = 0-1,2  = 0-1,1  =0. 


Now  we  define  coefficients  bkr,  for  r = 0, . ..  ,k+ 1 and  k = —1, . . . ,'n-fl,  as  the  inner 
products 

hr  = {(j>kAk-r)  = / <f>k(x)(l>k-r{x)dx,  (2.2) 

Jlk.r 

where  Ik,r  is  the  common  support  of  4>k  and  d>k-r  and  normalising  constants  rik  are  the 
squared  norms 

nk  = \\Pk\\2  = (Pk,Pk),  (2.3) 

where  (•,  •)  is  the  inner  product  (2.2)  and  ||  • ||  is  the  corresponding  norm. 

Then,  setting  (Pk,  Pfc_r ) = 0 for  r = 1, 2, 3 gives 

Pk—r}  ~ ^kr^k—r-  (2.4) 

Taking  the  inner  product  of  (2.1)  with  itself  gives 
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3 

nk  = h o + ^2  [-2 flfcr  (<pk,  Pk-r)  + afrnfc_r]  , 

r= 1 

which,  by  using  (2.4),  gives 


3 

nk  = bk0-J2a2krnk_r. 

r— 1 

This  is  the  first  basic  equation  for  writing  {nt}  in  terms  of  {aA-r}  and  {bkr}. 
Now,  using  (2.1),  with  k replaced  by  k - 1,  k - 2,  k - 3 we  obtain 

(<!>k,  Pfc-3>  = bk3  = Ofc3«fc-3 
{4>k,Pk- 2)  = bk2  — ajt_2.l  (<7h.-,PA— 3)  . 

Hence 


Finally 
so  that 


0-k2'nk- 2 = h/c2  - Or— 2,l^-3- 

((f)k,Pk-l)  = bk  1 - UA-1,1  (<^A i Pk—2)  - ak- !,2  (<f>k,Pk-3) , 


(2.5) 


(2.6) 


(2.7) 


(2.8) 


afcin/c-i  = 6fci  - a*_i,i  (at.2nfc_2)  - ak-it2bk3.  (2.9) 

Equations  (2.6),  (2.7),  (2.8)  and  (2.9)  may  be  solved  to  determine  all  the  required  coef- 
ficients {afc7.}  and  {n/J  explicitly  by  substitution,  starting  from  n_i  = ||0_i||2.  This 
involves  0(n)  operations  for  n -f-  3 basis  functions.  The  best  approximation  to  a func- 
tion / (either  continuous  / = f(x)  or  discrete  / = (/i,...,/m)T  ) by  orthogonalised 
Gaussians  may  be  determined  explicitly  as 

n+l 

£ c^> 
j=-i 

where  Cj  = (Pj,  P,)'1  (/,  P,)  = (n^)"1  (/,  P^) . 

2.1  Numerical  example 

Here  we  use  the  procedure  for  constructing  orthogonalised  Gaussians  to  produce  an 
interpolant  to  data  obtained  from  a fast  response  oscilloscope1 . To  the  left  of  Figure  1 
we  see  the  first  three  orthogonalised  Gaussian  functions,  with  centres  specified  at  the 
integers  -1,  0 and  1,  with  support  growing  from  left  to  right.  The  figure  on  the  right 
shows  the  oscilloscope  data  **  and  the  fitted  o-Gaussian  interpolant  — . 


1 Oscilloscope  data  supplied  by  Centre  for  Electromagnetic  and  Time  Metrology,  National  Physical 

Laboratory,  London,  UK. 
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In  this  example  we  use  512  centres  and  choose  A = 2.5  in  (1.1).  Since  our  choice 
for  A requires  only  four  decimal  place  accuracy,  the  normal  equations  produce  the  usual 
identity  matrix  and  the  coefficient  vector  {c_i, . . . , cn+ 1}  can  then  be  determined  by  the 
equations  c = AT f where  f = {fi,  ■ ■ ■ , fm}  and  Aij  = Pj(xi).  The  fit  is  extremely  good 
and  vindicates  the  neglecting  of  the  Gaussians  outside  the  interval  considered. 


FlG.  1.  First  three  orthogonalised  basis  functions  and  o-Gaussian  fit  to  oscilloscope  data. 

2.2  Extensions  to  orthogonalised  Gaussians 

The  following  extensions  are  clearly  possible. 

(i)  Use  of  generally  placed  centres  (knots)  and/or  a discrete  inner  product. 

(ii)  Use  of  higher  dimensions  - as  in  Anderson  et  al  [2]. 

(iii)  Replacement  of  interval  (— oo,  oo)  in  a continuous  norm  by  [0,  n] 
and  [0,  n]  by  [0, 1]  using  scaling. 

(iv)  Consideration  of  a function  with  wider  (approximate)  support,  such  as  [—3,3] 
or  more  generally  [— r,  r]  for  r > 2. 

3 Chebyshev  polynomials  in  two-dimensional  collocation 

The  (first  kind)  Chebyshev  polynomial  Ti{x)  of  degree  i is  defined  by 

Ti(x)  = cosi6  i = 0,...,m,  —1<x<1,  (3-1) 

where  x = cos  6 and  0 < 6 < ■k. 

Among  its  many  properties  is  the  discrete  orthogonality  property 

m f 0 for  i ^ j;  i,  j < m — 1 

y'jTi(xk)Tj(xk)  = < m for  i = j = 0 (3.2) 

fc= l ^ for 

where  Xk  are  the  m zeros  of  Tm( x),  namely 
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Xk  = cos 


The  orthogonality  property  of  (3.2)  is  not  a unique  one  amongst  the  Chebyshev  poly- 
nomials of  four  kinds.  Indeed,  Mason  and  Venturino  [5]  showed  that  there  are  at  least 
fourteen  such  formulae,  depending  on  alternative  weights,  choices  of  Chebyshev-related 
abscissae  and  kinds  of  Chebyshev  polynomial. 

3.1  The  elliptic  problem  — mixed  methods 

Let  us  now  exploit  this  property  (3.2)  in  a pseudo-spectral  method  for  a linear  elliptic 
PDE  problem  on  a square.  The  PDE 


Lu  = f(x,y),  |z|,|y|<l, 


subject  to 


u = g(x,y),  (3.5) 

where  g(x,y)  is  a function  known  explicitly  only  on  x = ±1  and  y = ±1,  can  be  solved 
approximately  in  the  form 


u — umn  — ^ ^ ) UijTj{x)Tj(y), 

i= 0 j= 0 

where  a dashed  summation  denotes  that  the  first  term  in  a sum  is  halved. 
To  obtain  equations  for  aij,  we  solve 


Lumn  = /,  at  the  (m  — 1)  x (n  — 1)  zeros  of  Tm-i(x)Tn-i(y),  (3.7) 

umn  = g,  on  x = ±1  at  zeros  of  Tn(y)  (2n  equations),  (3.8) 

Umn  = g i on  y = ±1  at  zeros  of  Trn(x)  (2m  equations).  (3.9) 

Together  (3.7)-(3.9)  form  (m  + 1)  x (n  + 1)  equations  for  {a,-,}.  However,  we  claim  that 
the  included  equations  (3.8),  (3.9)  are  singular  of  joint  rank  2 m + 2n  — 1.  If  this  is  so, 
then  the  system  is  singular  without  consideration  of  the  PDE  collocation  equations  (3.7). 
The  equations  (3.8),  (3.9)  become 

mn  m n 

9k, ± x = E'  E'  «ijTi{xk)Tj(±  1),  g±u  = E'  E'  Ob7i(±l)7i(^),  (3-10) 

i=0  j— 0 i=0  j= 0 

where  Xk,ye  are  zeros  of  Trn(x),Tn (y)  respectively  and  where 

9i,t  = 5(1.  ye),  9-U  = g{-l,  ye), 

9k, i — g(xk,  l),  5fc  -i  = g{xk,-i). 
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If  we  add/subtract  the  first  pair  and  also  the  second  pair  of  equations  in  (3.10),  noting 
that 

Tj(  1)  = 1,  Tj{- 1)  = (-l)fy 

we  deduce  that 

m n m n 

4 ^ = E aiiTi{xk),  4^  El'  aijTj(xk),  k = l,...,m,  (3.11) 

*= o 1=0  i=0  j=0 

( j even)  (j  odd) 

m n m n 

40)  = E'E 41)=E'  E'oi/W),  *=i (3.i2) 


i=0  1=0 

(i  even) 


i=0  1=0 

(i  odd) 


where, 


4°^  — + 3fc,-i)>  4^  = |(5fc,i  - 

40)  = 5(31/  + 9-i, e),  41}  = 2(31/  _ 3-i, f)- 

Multiplying  (3.11)  by  2TT(xk)/(m  + 1)  and  summing  over  k,  and  multiplying  (3.12)  by 
2 Ts(yg)/(n  + 1)  and  summing  over  £,  discrete  orthogonality  (3.2)  gives 


4-+1  — E/  arj  — 4+i>  4u-E°rl"4i>  r — 0, 1,  (3.13) 


l=o 

(1  even) 


j=r 
(j  odd) 


/»«-  7 71 

^+1  = E'a-  = ci+1>  <4+i  = Ea-  = 4+1-  s = 0, . . . ,m  — 1,  (3.14) 


i=0 

(i  even) 


t=0 

(i  odd) 


where 


O '"  o m 

e = £fy  £ ^ E 

® 1 40,r.(«)  4+1  = ^ E ftw. 

^ f=i  71  r=i 

This  constitutes  a greatly  simplified  system  to  replace  (3.10).  Indeed  we  may  verify 
that,  for  m = n, 


E ' <>.  = E ' dh. 

i= 0 i=0 

(m  — i odd)  (m  — i odd) 
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where  t = 0, 1 for  m = odd,  even,  respectively,  and  hence  that  the  equations  (3.13)  and 
(3.14)  are  singular.  For  example,  for  m (=  n)  = 2,  we  seek  equations  in  a00, . . . ,022,  and 
(3.13)  gives 


meanwhile  (3.14)  gives 


= ^aoo  + flo2i 

R^  = |aio  + ®i2) 


R?'  =001, 

= an, 


(3.16) 


Cf  = ^aoo  + a2o,  Cp  = aio,  . . 

r(°)_i . , ’ 

02  =2a01+®21)  '-'2  = 

Clearly  R^  = C^\  consistent  with  (3.15)  for  m = 2.  Which  equation  do  we  eliminate? 
For  simplicity,  in  the  case  of  m even,  we  delete  the  equation  for  and  replace  it  by 
the  equation  for  R^+1.  It  is  easy  to  verify  that,  within  the  system  (3.13)  and  (3.14),  this 
leads  to  full  rank,  and  R^+1  is  equivalent  to  boundary  specifications  of  either  of 


u(0,l)  + u(0,-l),  (3.18) 

ti(l,l)  + u(-l,l)  + u(l,-l)  + «(-l,-l). 

For  m = n — 2,  this  is  equivalent  to 


R 3°)  = 2°20  + °22'  (3.19) 

In  the  case  when  m is  odd,  we  delete  the  equation  for  C'j0)  and  replace  it  by  the 
equation  for  C^+1,  the  latter  being  equivalent  to  adding  four  boundary  point  conditions 
anti-symmetrically,  i.e., 


u(l,  1)  - u(-l,  1)  + u(-l,  -1)  - u(l,  -1).  (3.20) 

If  g(x , y)  is  known  everywhere  in  the  square,  then  we  could  of  course  consider  replacing  a 
mixed  collocation  problem  by  an  interior  collocation  problem  by  including  the  boundary 
conditions  automatically  in  the  form  of  approximations.  For  example,  we  could  replace 
the  form  (3.6)  by 

m— 2 n— 2 

umn  = (x2 -l)(y2 -1)^2'  ^2' aijTi(x)Tj(y)  + g(x,y),  (3.21) 

i= 0 j— 0 

or  by  an  alternative  form  such  as 

i m n 

umn  — ^ ^ ^ ^ aij  {Ti(x)  ~ 7] [(#))  (^j{y)  ~~  (3.22) 

2=0  j=  0 
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where  T)  = T0(x)  or  Ti(x)  according  as  i is  even  or  odd.  These  forms  have  the  disad- 
vantage of  being  difficult  to  generalise  to  other  kinds  of  (non-rectangular)  boundaries, 
although  (3.21)  is  adaptable  to  the  case  where  an  equation  of  the  boundary  is  known 
(see  Mason  [3]). 

The  best  Chebyshev  method  available  for  the  Poisson  problem  on  a rectangle  is 
probably  a “differentiation  matrix”  method,  such  as  is  described  in  Trefethen  [6] , which 
represents  the  solution  by  nodal  values  rather  than  Chebyshev  coefficients. 

Acknowledgement:  We  thank  the  referees  for  their  perceptive  remarks. 
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